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Abstract. In this work, we study the orbital stability of stationary solutions to 
the relativistic Vlasov-Manev system. This system is a kinetic model describing 
the evolution of a stellar system subject to its own gravity with some relativistic 
corrections. For this system, the orbital stability was proved for isotropic models 
constructed as minimizers of the Hamiltonian under a subcritical condition. We 
obtain here this stability for all isotropic models by a non-variationnal approach. 
We use here a new method developed in [23' for the classical Vlasov- Poisson 
system. We derive the stability from the monotonicity of the Hamiltonian under 
suitable generalized symmetric rearrangements and from a Antonov type coer- 
civity property. We overcome here two new difficulties : the first one is the a 
priori non-continuity of the potentials, from which a greater control of the re- 
arrangements is necessary. The second difficulty is related to the homogeneity 
breaking which does not give the boundedness of the kinetic energy. Indeed, in 
this paper, we does not suppose any subcritical condition satisfied by the steady 
states. 



1. Introduction and main results 

1.1. Introduction to the relativistic Vlasov-Poisson system. The relativistic 
Vlasov- Poisson system in dimension three reads: 



dtf + ^^^= • V,/ - v,0/ • V,/ = 0, 



x/TT 



^2 X 



ii.i) 



. f{t = 0,x,v) = fQ{x,v) > 0, 
where the gravitational Poisson field (j)f is defined for all t G by 



A(t)f{t,x) = pf{t,x) = f{t,x,v)dv, , . 

(j)f{t,x) — )• as |x| — )• -|-oo. 
This expression is equivalent to: 

^fi^) = -YTl * P- (1-3) 

This nonlinear transport system describes the evolution of a stellar system subject 
to its own gravity with some relativistic corrections. 

The Cauchy problem of equations of Vlasov-Poisson type is not yet well under- 
stood for weak solutions: although the existence of local weak solutions has been 
proved , the question of its uniqueness remains unknown (see [7]). Moreover, for the 
relativistic case (jl.ip . in the most recent works about the Cauchy problem of smooth 
solutions, only radial smooth initial data have given results (see [12] and [26]). In 
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particular, Glassey and Schaeffer |12| have proved for radial smooth solutions that 
a blow-up in finite time T is characterized by the blow-up of the kinetic energy 

/ ( vRP + l ~ 1 ) /(^' v)dxdv — >• -|-oo as t — )■ T. 

There holds for smooth enough solutions of system (|l.ip some important conser- 
vation properties: first, the total Hamiltonian 



nf(.t))= [ (V\v\^ + l-l) f{t,x,v)dxdv-l [ \V^f{t,x)fdx, 



(1.4) 



is preserved in time and second we have the conservation of all Casiniir functions: 
for all P G ei(M+,M+) such that /3(0) = 0, 

/ l3{f{t,x,v))dxdv = l3{fo{x,v))dxdv. (1.5) 

The property (jl.Sp is equivalent to the equimeasur ability: 

Vt>0, fif(^t) = fifg, (1.6) 

where the distribution function ^/ is defined by 

Vs>0, fif{s) = mecis{{x,v) eR^, f{x,v) > s}. (1.7) 

Remark that in particular, the norms of / are conserved. 

In this paper, we will consider weak solutions to (jl.ip in the natural energy space 

£p = {/ > with / e L^{R^) n LP{R^) and y^l + \v\^f G L1(M6)} . (1.8) 

For all /o G £p, from classical kinetic Cauchy theory, the system (|l.ip admits 
a local renormalized solution f{t) in the sens of Diperna-Lions [9l [10]. This solu- 
tion satisfies (jl.Sp and (jl.6p but the conservation of Hamiltonian does not occur in 
general: it only remains 

Vt>0, 5{(/(t)) < 5{(/o). (1.9) 

Note that, from this nonincreasing property and from (jl.Sp . the kinetic energy will 
be bounded if /o satisfies a certain subcritical condition 

2p-3 



CpWfowir'^ wfowi'r' <i. (i.io) 

Indeed, from Hardy-Littlewood-Sobolev inequality, the potential energy satisfies 
forah/Gfip, If \Vcl,ffdx<Cp\\f\\f^\\f\\]f^ ./TTWf (I-H) 

where Cp is defined as the best corresponding constant and thus the kinetic energy 
can be controled thanks to 

nf) >(i-Cp ii/iif^ ii/iiif^) ||^/^TH^/||^^ - 11/11^1 . (1.12) 

Hence we have global existence for the system (jl.ip as soon as /o satisfies the 
subcritical condition (jl.lOp . 
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1.2. Main results and strategy of the proof. Our main result gives the nonlin- 
ear stability of a large class of stationary solutions for the relativistic Vlasov-Poisson 
equation. We adapt here some techniques introduced for the classical Vlasov-Poisson 
equation \23\ . 

Note (see [1] for the Vlasov-Poisson system) that the isotropic steady states of 
the system (jl.ip are the functions of the form 

Q{x,v) = F{e), 

where e is the miscroscopic energy given by 



e{x, v) = vfuP+T -1 + <I)q{x). 

An important question which has been the subject of several works is the question 
of nonlinear stability of these steady states when F satisfies 

dF 

For some of these stationary solutions, built as minimizers of suitable functional, 
the concentration-compactness Lemma (|27|- |28| ) allows to prove their stability 
under a subcritical condition of the type (jl.lOp . see |21| . Here we get the nonlinear 
stability of all these stationary solutions in the energy space £p, defined by (|1.8p . 
with respect to its natural norm: 



Li + ll/l|L. + ||x/rTH^/||Li. 

Theorem 1.1 (Stability of spherical models). Let Q he a spherical, continuous, 
nonnegative, non zero, compactly supported steady solution to (jl.ip . Assume that Q 
is a nonincreasing function of its microscopic energy, i. e. there exists a continuous 
function F : M — > M_|_ such that for all (x, v) £ 



Qix,v) = F i^y/\v\^ + I - I + cj)Q{x)j , (1.13) 

and there exists eo < such that F(e) = for e > cq, F is decreasing and on 
(— oOjeg). Let p > |. Then Q is orbitally stable in the Ep-norm by the flow (|l.ip .' 
for all £ > there exists t] > such that the following holds true. Let /o E £p be 
such that 

\\fo-Qh^<ri (1.14) 

and let f{t) be a corresponding renormalized solution to (|l.ip on [0, T). Then for 
all t S [0, T) there exists a continuous translation shift z{t) such that 

\\f{t,x,v)-Q{x-z{t),v)\\^^<e. (1.15) 

In the radial case, since a blow-up in finite time is equivalent to a blow-up of the 
kinetic energy, Theorem 11.11 provides global existence when the initial data is near 
the (non necessary subcritical) function Q. The existence of such Q away from all 
subcritical class of functions is an open problem. 

Strategy of the proof: This proof uses arguments developed in |23) for the classi- 
cal gravitational Vlasov-Poisson system. But here two new main difficulties appear: 
the first one is that the studied class of functions in the energy space £p does not im- 
ply the boundedness of the potentials and the second one is related to the breaking 
homogeneity character of the relativistic problem. Let us give the global strategy 
of the proof. 
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For / E £p, we know that there exists a nonnegative function on M+, /*, which 
is the Schwarz symmetrization of /, such that 

Vs > 0, ^/(s) = ^/.(s). 

We can similarly build a rearrangement with respect to the microscopic energy 

e(x, v) = v[uP + l - 1 + (f){x), 

for a non zero potential (j). This rearrangement f*'^ is defined by 

j*(f> _ J* Q with 00 (A) = meas{(x, t;), e{x,v) < A} 

and satisfies 

Note that, in the classical Vlasov-Poisson case, this monotonicity of the Hamiltonian 
was observed in the physics literature \25\ [TT| |3H [1] . Now by defining the functionnal 
J by 

J{4>) = Ji{Q*^) + ^\\V<PQ,,-V(t>\\l,, 

we shall prove that 

r+oo 

nf) - nQ) > Jih) - Ji<pQ) + %'(s)(r(s) - Q*is))ds. (1.16) 

Hence we can reduce our problem to the study of the functionnal J which only 
depends on the potential (j). Moreover, from the Polya-Szego inequality, we get 

where (p* is the Schwarz symmetrization of (p, and therefore the study of J can be 
restricted to radial modes. We then use the Burchard-Guo compactness result |8] 
to get the compactness of (j) from that of 0* . 
Our proof is performed in two steps: 

(i) Proof of the local coercivity of J on radial potentials (f) near (j)Q. 

(ii) Proof of Theorem 11.11 via a local compactness proposition thanks to (|1.16p . 
This second step will be deduced from (|1.16p and equimeasurability arguments 
derived from the rigidity of the fiow. The local coercivity stated in the first step 
will follow from the Taylor expansion near (j)Q for radial potentials 

J((/.) - J(<Aq) = ^D\j{cf>Q){<p -<PqA- <Pq) + o (II V0 - V0Q||i.) 

and from the strict coercivity of the quadratic form D^J{(Pq). To prove this coerciv- 
ity, we follow the same lines as [23j where a Poincare-like inequality was proved for 
the classical Vlasov-Poisson system. This inequality is a generalisation of Antonov 
type coercivity estimate and is based on a Hormander approach |18| [T9] . The main 
new difficulties here, lie in the control of the jacobian a<^ which can't be bounded 
in general because of the non boundedness of the potential and the homogeneity 
breaking. 

This papers is organized as follows. Section [2] deals with the proof of the local co- 
ercivity of the functional J near (pQ stated in Proposition 12.21 By differentiating the 
functional J at (pQ in Subsection 12.11 we obtain the second order Taylor expansion 
stated in Lemma [2.31 Then, in Subsection 12.21 from Hardy type control argument, 
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we deduce the Proposition 12.21 for radially symmetric potential and we finally gener- 
alize this proposition for all potential by using a compactness argument [8]. Section 
[3] is devoted to the proof of Theorem 11.11 from the coercivity result stated in Section 
[2j First, in Subsection 13. H we prove the local compactness of local minimizing se- 
quences, Proposition 13. 11 Then, in Subsection 13. 2[ by using this compactness result 
combined with a contradiction argument, we finally deduce the orbital stability. 
Theorem 11.11 The several property about the generalized rearrangement used in 
these both sections can be found in the completed study of the rearrangement with 
respect of the microscopic energy stated in Appendix A and B. 



2. Coercivity of the functional J 

The aim of this section is to prove the following proposition 12. 21 below. Our study 
is based on rearrangements with respect to the microscopic energy. To define these 
rearrangements, we introduce, for q > 3, 

$g = I G L«(M^) s.t. (/) < 0, m(0) > 0, Vcf) e L^{M.^), lim = 1 , (2.1) 

with 

m((/>) = inf (1 + |x|) |</>(x)|, (2.2) 

and the norm on $q 

The space is a natural space for the potential of distribution functions in £p, as 
given by the following lemma. 

Lemma 2.1. Let f ^ 8.p non zero with p > |. Then the potential (f>f belongs to $g 
for all3<q< ^^^^{< 12). 

Proof. From classical interpolation methods and from the Hardy-Littlewood-Sobolev 
inequality, we have for f £ £,p with p > 1 

Pf e L^{R'), 1 < r < ^ and 0^ G L''{m'), ^ < g < fc^. 

Moreover, for p > | the Hardy-Littlewood-Sobolev inequality implies that V(/>j 
belongs to L^{R^). We prove now that m{(pf) defined by (|2.2p is positive. Since / 
is non zero, the density p/ is non zero, too. Hence there exists R > such that 



M := pf{x)dx > 0. 

J\x\<R 



We have then 

|^,(.)| = / U^,y > / > / -li^dy. 

Jf,3iir\x-y\ 7|j^|<R 47r|x - y| 7|y|<j^ 47r(|x| + i?) 

Finally, 

{\x\+R)\cl>f{x)\>M, 
which concludes the proof of lemma 12.11 □ 
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Now for S <I>q and f ^ 8.p with p > |, we define the jacobian by 

Ve < 0, a(^(e) = meas f ) G M'^ : - ^ + 4>ix) < e] , (2.4) 

and the rearrangement with respect to the microscopic energy by 

r (a^(\/|i^|2 + l-l + (/<(x))) if V|t;|2 + 1 - 1 + </,(x) < 



/ 



(2.5) 



if ^/\v^H^-l + (j){x) >0, 



where /* is the Schwarz-symmetrization of / in M^. In Appendix |X] we recall some 
properties about the Schwarz symmetrization and we give all the properties we need 
about the Jacobian and the rearrangement with respect to the microscopic energy. 
In particular, f*'t' is well defined in £p and the function Q defined in Theorem 11.11 
satisfies Q = Q*'t'Q . 

Using these definitions, we introduce the functional J on <I>g defined by 

J(0) = / (VW+^ - 1 + <^{x)) Q*^dxdv + \ \\V4>\\1, , (2.6) 
which is equivalent to 

J{<i,) = Ji{Q*^) + \ ||V(^Q*0 - V(/>||' . (2.7) 



2 II ^ ^Q*f ^ r||i2 

We claim now the following Proposition which we prove in the next subsections. 

Proposition 2.2 (Local coercivity of the functional J). There exists a constant 
^0 > such that, for all q > 3, the following holds true. Let a sequence (pn of 
such that 

Vn G N, WVcPn - V(/)q||^2 < So and lim J((^„) < J(0q). (2.8) 
Then there exists a sequence of translation shifts in space x„ such that 

\\V^n - ^(t>Q{- - Xn)\\L2 ^ as U ^ +00. (2.9) 

This coercivity of the functional J near (j)Q is the first step to prove the stability 
of Q stated in Theorem ll.il To obtain it, on the one hand, we will look for a second 
order Taylor expansion of J around </>q and, on the second hand, we will control 
the second derivative of J at (pQ thanks to a Poincare-type inequality. 

2.1. Second order Taylor expansion of J at (pQ. In order to prove Proposition 
12.21 we give first a Taylor expansion of the functional J near the potential (pQ . 



Lemma 2.3 (Taylor expansion of J). Let 6 < g < 12 and (p,(p €z ^q. Then the 
function 

J(0 + A(0-0)) 

is twice differentiable on [0, 1] . 

Moreover, for (p in ^q radially symmetric, there holds the Taylor expansion near 
4>q: 

J{(P) - J{<Pq) = ]^D^J{<Pq){<P -<Pq,<P- <Pq) + e{\\V<P - V<Pq\\l2), (2.10) 
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where e{5) = o(5^) as 5 — )• 0. 

Finally the second derivative of J at (j)Q in the direction h is given by: 
D^J{^Q){h,h) = [ \Vh\^dx- [ \F'{e^Q{x,v))\ih{x)-Uh{x)fdxdv, (2.11) 



where e^pg^x^v) = y^l + |f ^ — 1 — 4>q{x) and Hh is the projector defined by 

(^{l + e^g{x,v) - (pQ{y)f_^-l)' {l + e^Q{x,v) - (j)Q{y)) h{y)dy 



Iih{x) 



R3 



(^[l + e^Q{x,v) -(t)Q{y))\ - l)^ {l + e^Q{x,v) - (pqiy)) dy 

(2.12) 



Remark that the function Hh can be seen as the projection of h on the functions 
of the microscopic energy e^g {x,v). To prove the lemma [2^ we will first prove that 
J is two times differentiable on <I>g, then we will evaluate its derivatives on (/)q and 
finally we will control the rest of the expansion for radially symmetric potentials. 

Proof. Let Jq be a functionnal on $q, defined by 

Jo (</,)= /" (^|t;|2 + 1 - 1 + (t){x)] Q*^dxdv = [ e^{x,v)Q*'f'dxdv. (2.13) 
Then J is given by 

m = M^) + \ iiv0iii. . (2.14) 

To differentiate J, we just have to differentiate Jq. Let £ and h = (p — (p. 

We study then the function A i— )• Jo(0 + Xh) on [0, 1]. 

First derivative of Jq . From the change of variable (jA.lip , we get 

Jo{(p) = eQ*{a^{e))a'^{e)de= I e{G o a^)' {e)de, 

Jiniij) J inf <f> 

where G is the bounded function, with bounded derivative, defined by 

G{s) = [ Q*{a)da. (2.15) 







Moreover, from the property (jA.SP in lemma lA. 21 the jacobian a^(e) converges to 
as e — )• inf (p. Thus we have [eG o CLcf>{e')]^^f^ = and an integration by parts gives 

Jq{(I)) = -[ Goa^{e)de. (2.16) 



Step 1 : first derivative of Jq . 

To differentiate Jq given by (|2.16p . we shall use the Lebesgue's derivation theorem. 
From formula ()A.9P in the Appendix, we have for all e < 

d d 

-Q^G{a^+Xh{e)) = Q*ia^+xh{e))-^a^+xhie) (2.17) 

with 

d f 

—a^+Xh{e) = -47r / K {e - (pix) - Xh{x)) h{x)dx, 
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and 

i^(r/) = ((1 + 7?)^ -1)^(1 + ,?). (2.18) 
Note that the uniform inequahty 

3 

.X '^T^ f ( ( minimi 6), mi 6)}^ \ , 

and the compact support of Q* imply that there exists cq < such that 

Ve > eo, VA G [0, 1], Q*{a^+xh{e)) = 0. (2.19) 
Moreover, we have for ah e < eo, for all A G [0, 1], 
d 



—a^+xh{e] 



< 47r / K(eo- 0(x) - ^{x)) \h{x)\ dx, 
and Q*(a<^+A/i(e)) < ||Q||oo- Finally we obtain, by noting ^\ = (f) + Xh 

J- Jo(<^a) = 47r r / Q*{a^^{e))K{e-<l){x)-\h{x))h{x)dxde. (2.20) 

Step 2 : second derivative of Jq. 

We keep the previous notations. An integration by parts with respect to e yields 

§^MM = - Y £ Q*'Me))a'^,ie) ((1 + e - M^))l ' l)lh{x)dxde. 
We perform now the change of variable s = a^^ (e) , which gives 

§^MM = -yCL ((^ + ~ Mx))l - 1) ' Hx)dxds, 

(2.21) 

where Lq is the measure of the support of Q and thus satisfies Supp{Q*) = [0, Lq). 
Define 

, 3 

2 \ 2 



gi\,x,s) := ((1 + a^'^is) - M^))l ' l) 



Prom the first step, for all A G [0, 1] and for all s G [0, Lq], we have a,^^{s) < eo and 
thus the set 

{x G R^, g{X, X, s) 7^ 0} C {x G R^, (l)x{x) < eo} C {x G M^ ^(x) + ^(x) < eo} 

is uniformaly contained in the bounded set O = {x G M^, (/)(x) + ^(x) < bq}. 
Moreover, by recalling the notations h = cf) — 4> and 

1 

K(77) = ((1 + 77)^-1) '(1 + r?), (2.22) 
we have for (A, x, s) G [0, 1] x O x [0, Lq] 

|^(A,x,s) = (a^^i(s) - 0(x) - A/i(x)) (^-/i(x) + ^a^',(.s)^ , (2.23) 
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where, from lemma (|A.2p in Appendix, 



K 



a^^ {s) — (f>{x) — Xh{x)j h{x)dx 

j K (a-^l{s) - (p{x) - \h{x)) dx 

To differentiate (j2.2ip with respect to A, we first prove at fixed s G (0, Lq) 
d f f dg 

— / g{X,x,s)h{x)dx = / —{X, x, s)h{x)dx. (2.24) 

Let fixed s G (0, Lq). We begin by bounding -^CL^lis). For ah x G M'^ 

(j){x) + Xh{x) > (p{x) + 4){x) and a^^{s) < eo, (2.25) 

which provides 

0< / K (^a-^{s) - <p{x) - Xh{x)^ h{x)dx < / K (^eq - (j){x) - 4>{x)^ h{x)dx. 

(2.26) 

Now denote 

1]a = {xGM3, 0,(x)<a^^i(0}. 
Then the set Vtx is included in and 

meas {^x) = o a'^ (^0 = |. 
Moreover, for all x G J^A) we have 

' s 
.2 

which, combined with 



Vr/ > 0, K{r,) = (r/ (2 + r/))| (1 + ??) > y^, 
implies 

We claim that, at fixed s > 0, there exists a constant C > such that for all 
A G [0, 1] 

Indeed, assume that the property (|2.28p does not hold, then there exist A G [0, 1] 
and a sequence (A„) such that, as n — )• +oo, 

A„ — )■ A and aT^ (s) — a7^ ( -] — )• 0. 

From lemma PV.21 in Appendix, we conclude that 

<^^)-<{^=^^ 

which is not possible since s > and a^]^ is strictly increasing on M^. Finally from 
the inequalities (j2.26p and (I2.27p . for s G (0, Lq) there exists a constant Cg > such 
that for aU AG [0, 1], 
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We can thus uniformly bound 
d 



dX 



< 3 1 + eo - ^{x) - (t>{x) 



(x) - 4>ix) + a 



where we used (j2.25p and the fact that K(ri) < (1 + r/)^. By noticing that the 
function (p+cj) belongs to Lf^^(R.^) (since q>3), Lebesgue derivation theorem provides 
(IMD . 

Now aim to integrate with respect to s £ {0,Lq). We define for all s € (0, Lq) 
and for all AG [0, 1] 



d 



dX 



I{X,s):=— / g{X,x,s)h{x)dx = / —g{X,x,s)h{x)dx, 



d 



dX^ 



which is continuous function of the variable A. Remark that 

IiX,s) = ?, j^K{a-^l{s) - Mx)) ly-h{x) + l^a^'(s)) Kx)dx, 
where, from Cauchy-Schwarz inequality, 



K (a-^l{s) - Mx)) -^h{x)dx 








h{x)dx^ 


J 




dx 



< 



K {a-^l{s) - <t>x{x)) {h{x)fdx. 

(2.29) 



Thus, we have 



|/(A,s)| <3 (k [a-^l{s) - ct^y^ix)) {h{x)f dx. 



Moreover, since Q* is decreasing from to 0, the function Q*' belongs to 

-L^(0, Lq) a-iid finally, from Lebesgue's derivation theorem, we get 

^Jo(0a) = j^' j^^ Q*'{s)K [a^'^is) - M^)) {h{x)fdxds 



4vr / Q*'{s] 
Jo 








h{x)dx^ 


J 


^ /^(a^^i(«)-0iW) 


dx 



(2.30) 



ds. 



Using the change of variable e = a^^{s), we get 



5A2 



Ji 



An 



Q*\a^^{e))a'^^{e)K{e - <t>x{x)) {h{x)ydxde 



-A-K / Q*'(a^,(e))a;^(e) 



K [e — 4>x{x)) h{x)dx 



[ K{e-(l,x{x))dx 



-de. 



(2.31) 



Step 3: derivatives of J at 
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Let (j) e and h = (j) - (pq. Then, by ^(TM) . 

DU(t>Q){h) = 4Tr r [ Q*{a^Je))K (e - M^)) h{x)dxde 

Note that, from lemma lB.2| the function F defined by theorem 11.11 satisfies 

Q*{a^^{e))=F{e). 

1 

\2 1 \ 2 



Now perform the change of variable u = y{l + e — (t>Q{x))^ — Ij with respect to 
e. Then 

DJoicpQ)ih) = 4iT r [ F (y^l + \v\^ - 1 + (j)Q{x)) u^h{x)dxdu 
= / Q{x,v)h{x)dxdv. 

Hence, from (I2.14p . 

DJ{<l)Q){h) = DJoi(PQ)ih) + [ V<Pq- Vhdx = 0, 



where we used the Poisson equation satisfied by (pq. 

We now give the exphcit expression of the second derivative of Jq at ipq. Remark 
first that F'{e) = <5*'(o0q (e))a^^ (e) and thus from ()2.3ip . 

D^Jo{^q){h,h) = 47r r f F'{e)K {e - (Pxix)) {h{x)fdxde 







oo 



V 

K {e — (pxix)) h{x)dx j 

-47r / F'(e)^^. ^—de. 

K {e — 4>x{x)) dx 



We apply the change of variable u = ^(1 + e — (j)q{x))_^ — Ij with respect to e to 
get 

D^Jo{(t>q){h,h) = [ F'{e){h{x)fdxdv- [ F' {e)Uh (e) h{x)dxdv, 



where e = e{x, v) = \J\ + |f p — 1 + 4>q{x) and II/i is the projector on the space of 
functions depending only on e{x,v\ defined by ()2.12p . Hence we have 



D^M^Q){h,h) = / F'{e{x,v)){h{x)-Uh(e{x,v))ydxdv, 

and the decomposition (|2.14p provides 

D^J{(l)q){h,h)=D^Jo{cj)q){h,h)+ [ \Vh\^ dx, (2.32) 

which concludes the proof of (|2.1ip . 

Step 4-' proof of the Taylor expansion (j2.10p .- 

Let (/) E <I>q radially symmetric and h = <j) — (f)q. We note for A G [0, 1], (px '■ = 
<j)q + Xh. Then, using DJ{(j)q){h) = 0, we have 
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J(</>Q +h)- J{<Pq) = -D^J{^Q){h, h) 



+ \\Vh\\l, / (1 - A) [D^U^x) - D^U^q)) 



\\vhu.'\\vh\\ 



L2 



It is sufficient to prove that 

sup sup 

Ae[o,i] ||vh||^2=i 



[D^Jo{ct>^)-D^Jo{ct>Q)) ih,h 



d\. (2.33) 



(2.34) 



as ||V(/)— V(/)q||^2 — )• to obtain the Taylor expansion (I2.10p . Note that the functions 
h in ()2.34p are taken to be radially symmetric. In order to prove ()2.34p we argue by 
contradiction. Let e > 0, V'n S ^q, hn S and A„ G [0, 1] such that 



llV^/^n - V(/)Q||i2(K3) 



< 



n 



Nhn\\L2(R3) = 1 



and 



[D^Jo{cf>n)-D^Jo{4>Q)) (hn,K 



> e, 



where (/>„ = (! — Xn)<pQ + ^n^Pn- The sequence (j)n satisfies 



\\V(j)n - V</>q||l2(ir3) < -. 



n 



We recall from (jOOj) that 



D'MM K, K)=4tt Q*'{shn{s)ds 



Lo 



(2.35) 
(2.36) 

(2.37) 
(2.38) 



where 



7n(s) = / gnix,s){hnix)fdx 



gn{x,s)hnix)dx 



gn{x,s)dx 



(2.39) 



and 



(x, s)=({l + a^^is) - Mx)) - 1 ) (1 + a^^is) - 0„(x)). 



Notice first that the convergence ()2.37p implies the convergence of (pn to (pq in 
L6(M3). Thus, from (lAlSj) . we have 



(2.40) 



Moreover, we have 



■n{r)\ < / \4>n{r)\dr<\\rcl>'^{r)\\L2^^^) 



+ 00 



:dr 



where we used the convergence (p^ii^v^ to as r — ^ -t-cx) from the definition of It 
gives 



Vr G 



\(pn[r)\ < = < 



1 • 

T 2 



(2.41) 
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Thus the set of integration in x in the integral (j2.39p can be restricted to a bounded 
domain uniformly with respect to s G [0, Lq]. Indeed, from the increase of a^^, 
for all s G [0, Lq], 

Dn{s) := {xeR^ : </.„(x) < a^^s)} c{xeW^ : (/>„(x) < a^^Lo)}, (2.42) 
and, since cpn G is nonpositive. 



DJs) C <! x G : \x\ < ^ '> =: Q 



(2.43) 

L ^0 ) 

where cq = sup„gpj a^^^(Lo) < 0. 

Now, from the local compactness of the Sobolev embedding ^ Lf^^ for 1 < p < 
6, there exists h G H^^^ such that, up to a subsequence, 

<Pn (pQ and hn ^ h in U'{Vt) as n — t- +oo. 

At fixed s G [0,Lo], these convergences combined with the convergence (|2.40ll pro- 
vide, on the one hand, the convergence for all i G {0, 1,2}, 

W in L^{VLs), 
and, on the other hand, the convergence of 

X ^ gn{x, s)^ = 2r] + brf + Aij^ + rf with rj = (a^^is) - <l)n{x) 
in LI.{Q,) to g(-,s)'^ where 

9{x, s) = ((l + a^lis) - 0q(x))' - l) ' (1 + - M^))- 

Thus, for all i G {0, 1, 2}, as n — )• +00 

Qnix, s)U^ g{x, s)U in LI{W^). 
The convergence of 7„(s), at fixed s, follows. Now, by Cauchy-Schwarz, we have 



gn{x,s)hn{x)dx 



gn{x,s)dx 



< / gn{x,s){hn{x)fdx, 



which provides 



< 7n(s) < / gn{x,s){hn{x)fdx 

< / gn{x,Lo){hn{x)fdx. 

Thus 7„ is uniformly bounded on [0, Lq] and from standard dominated convergence 
theorem, 



D'^-h{4>n) \ hn,hn] D'^Jo{(j)Q) [h,h] as +00, 



and similarly 



D Jo(<^q) [hn,hn) D Jo{(I)q) [h,h\ as n +00 



(2.44) 



(2.45) 



These convergences contradict (|2.36p . which proves the Taylor expansion (|2.1U|) and 
concludes the proof of Lemma 12.31 □ 
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2.2. Proof of Proposition [2T2I We use now the Taylor expansion stated in lemma 
2.31 to obtain the proposition 12.21 In a first step we prove the local coercivity of 
the functionnal Jq near (pQ for radially symmetric potentials by using a Hardy type 
control, obtained in a second step. In a third step, we finally pass from radially 
symmetric modes to general modes by using a compactness argument [8] which 
concludes the proof of the proposition 12.21 



Step 1: coercivity of the quadratic form D'^J{(f)Q) 

In this step, our aim is to prove that there exists an universal constant Cq > 
such that 

V/i G H}.,^ D^J{<t>Q){h,h) > Co\\Vh\\l,. (2.46) 

where the space 

HI^^ = \ he Lf^^{R^), radially symmetric, s.t. G L^(M^) and lim (j){x) = > 

is a Banch space. We consider the linear operator generated by the Hessian D'^{(Pq): 

Lh = -Ah-[ \F'{e)\{h-Uh)dv. 

Remark that the compactness of the quadratic form D'^J{4>q) on H^^^^ is given by 
the previous proof of the Taylor expansion. From the Fredholm alternative, we have 
only to prove the strict posivity 

V/i E Hl^d, h^O, {Lh, h) > 0. (2.47) 

to obtain the coercivity (|2.46p . From the Taylor expansion (|2.1ip . this inequality 
can be seen as a Poincare inequality with an explicit constant, and we shall adapt 
the Hormander's proof |18| [T9] to obtain it. 

Let us introduce the following operator T defined by 

r^rf . drf drf 

1 f{e,r) = J = , 

r2 ((1 + e - 0Q(r))2 _ 1)2 (1 + g - ^Q{r)) r^uVl + v? 

where 

u{r,e) = {{l + e-<t^Q{r))l-l)l. (2.48) 

Recalling that (f)Q{r) is strictly increasing and that Supp{F) = [0,eQ), we shall 
denote the space 

U = {(r,e), n > 0} = {(r,e), e G (</'q(0),0), r G (0,r(e))} with r(e) = (/.^^(e). 

Then we define on U = It Pi (0, r(eQ)) x ((/)q(0), eg), for a given h € H^^^, the 
function 

/(r,e)= f {h{T)-Iih{e)){{l + e-(t^Q{T)f -l)l{l + e-<PQ{T)ydT. (2.49) 

JO 

We can differentiate / and get, in particular, 

Tf = h- Uh. (2.50) 

Now let e > and study the behavior of f{e,r) for r — )• and r — t- r(e) when e 
belongs to ((/'q(O) + e, -e). Notice first that, from (|2.41ll . for all r > 

T^\h{T)\ < \\Vh\\L2, (2.51) 
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and 

Ve e {(PQiO) + e, -e), |m(e)| < C,. (2.52) 
These inequalities combined with the continuity of (pQ imply the existence of > 
such that, for all e S ((/)q(0) + e, —e) and for all r S (0, r(e)), 

\f{e,r)\<Cer^. (2.53) 

Moreover the function / satisfies 

r+oo 

f{e,r{e))= {h{T) -Ilh{e))u{r,e){l + e - (t)Q{T)ydT = (2.54) 

JO 

where we used 

»+oo 

_2. 



m(e) 







u{t, e)(l + e - (j)Q{T))h{T)T dr 



u{t, e)(l + e - (f)Q{T))T'^dT 



Hence, using (|2.5ip . (|2.52p and the increase of (pg, we get for e G (0q(O) + £,—e 
and r G (0, r(e)) 

|/(r, e)| = J^'''\h{r) - Uh{e)) ((1 + e - ,/.Q(r))2 _ l) J (l + e - </<Q(r))r2dr 
< C, ((1 + e - </.Q(r))2 - 1)^ (1 + e - 0Q(r)) T^'^ rtdr, 

in which 

((1 + e - 0Q(r))2 - l)i (1 + e - cPgir)) < (e - </.Q(r))t(2 - ./.q(0))^(1 - </.q(0)), 
and 

r-Ke) 3 



T2dT < C(r(e) - r) < (e - (?!'Q(r)). 

since (/>q(?') > inf{(/)Q(T), r € [r{—e),r{(j)Q{0)+£)]} > 0. Finally there exists > 
such that for all e € ((/)q(0) + e, — e) and for all r G (0, r(e)) 

|/(e,r)| <C,(e-</.Q(r))t. (2.55) 

Now denote 

I{h)= [ \F'{e)\{h-Uhfdxdv. 

First, passing to the spherical coordinates and performing the change of variable 
e = y^l + |f P — 1 + 0Q(r), we get from (|2.50p 

= 16,^/|F(e)|(.-n.)VVe..)vra^«e 

= levr^ /" \F'{e)\de [ {h{r) - Uh{e))drfdr, 
J<I>q{o) Jo 

where u{r,e) is defined by (|2.48p . Now, from (|2.55p and ()2.53p . we have 

(h(r(e)) - m(e))/(r(e), e) = and lim(/i(r) - Uh(e))f(r, e) = 0, 

r->-0 

from which an integration by parts gives 

I{h) < -IGtt^ / \F'{e)\fdrhdedr. 
Ju 
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This inequality, combined with the identity 

"3 

leads to: 



PQir) = -T- I \F'{e)\u{e,rfde, 



1 

f^if^Q) fir ( r^Q \ ^ ^ 

m < (4vr)S||V/ib2(K3) I / -2 / \F'ie)\fde] 



r 



l<t>Q{r) u{e,rf 

where we used Caucliy-Scliwarz inequalities. Performing the change of variable 
u = u{e, r) with respect to e, we finally obtain 

I{h) < ||V/i||,.2(K3) (^3 1 pQ{r)\F'{e)\-^-^^^==dxdv^ ' . (2.56) 
Now we claim the following Hardy type control: 

Uk) > 3/ + |P(e,|_^<i..„. (2.57) 

Assume ([2371) . then ([236]) yields 

Thus, letting e — )• yields h) > 0. Moreover, if (Lh, h) = 0, then / = on IX, 
which implies h{r) = Ilh{e) on U, also = {Lh, h) = || V/i||^2(]g3) and finally /i = 0. 
This concludes the proof of (|2.47p . 

Step 2: Hardy type control. 

Let us prove now the Hardy type control (|2.57p . Let (7 be a given smooth function 
in U and q such that / = qg. After easy computations, we get 

{Tff = g\Tqf + T{q^gTg) - > T{q'gTg) - ^f. (2.58) 

g 9 

We take g{e,r) = r^u{e,r)^. Then, remarking that 



du j^f f 



u 



2 



dr ^ u 

we have 

Tg = -j^=^= = 3 = — 3r(/)Q(r), 

and therefore 

t2 -3 f . ^ M"-) ^ 1 

Since A0q = pg, it implies 
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Injecting this into (|2.58|) and integrating on U yield: 

zdxdv 



+ / \F'{e)\Tl^f^^ 



dxdv. 



r-u-Vi- + u- , (2.60) 



where we used q^gTg = /^"y'- Now 

/ |F'(e)|r ( dxdv = 167r2 H \F'{e)\de /"^'^ dr ( f—) dr. 
J \ 9 J J^pgio) Jo \ 9 J 

From ()2.55p and ()2.53p . we can perform an integration by parts and we get 



j \F'{e)\T (^f^^ dxdv = 0. 



We obtain thus the Hardy type control (j2.57p which concludes the proof of the strict 
positivity of the Hessian D'^{(f)Q) on radial modes (|2.47p and therefore the coercivity 

(nasi). 

Step 3: end of the proof: Let us first prove the proposition 12 . 21 for radially symmetric 
potential. Let cpn a sequence of ^q, radially symmetric, such that 

VneN, ||V0„-V0q||^2 <5i, limsup J(</.„) < J(</.q), (2.61) 

where 5i will be defined later. Then we use the Taylor expansion (|2.10p and the 
coercivity (j2.46p . which holds only for radially symmetric potential: 

Ji^n) - J{<Pq) > ^ \\V<Pn - + edlV'/'n " V,/.q||^,). 

Now, since e{5) = o(5^) as 5 — t- 0, we can choose 5i such that 

V<5G[0,5i], ei5)<^6\ 



Thus 



which finally provides, from (j2.6ip . 

lim J((/.„) = J{(j)Q) and \\V(j)n - V(/>q||^2 ^ as n ^ +oo. (2.62) 

Let pass now at the general case. We consider a sequence (pn of ^q. We define then 
0* = —{—(pn)*, the opposite of the Schwarz rearrangement of (—(/>„)• We introduce, 
for all n G N, the potential 0„ given by 



It is the Schwarz rearrangement of defined as a function of M'^. Then we claim 
that we have 

J(0#) - J(0„) = ^||V</.#||i. - ^WV^l, < 0, (2.63) 
and that there exists a constant 6o > such that 

\\^(t>n - V</.q||^2 < So implies V0# -V4>q < 6i. (2.64) 
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Assume first that these claims are true and take the sequGiice such, tlicit 

Vn G N, ||V0„ - V0q||^2 < 5o, lim J(,/.„) < J(0q). (2.65) 

Then, from ()2.63p and ()2.64p . the sequence (f>n satisfies ()2.6ip and therefore satisfies 
()2.62p . Moreover we obtain the equality 

lim J{(j)*)= lim J{(j)n) = J{(I)q), 

ra— )-+oo n— >+oo 

which implies from (|2.63p 

lim \\Vcj)*\\^2= lim WVcPnh^- (2.66) 

n— >+oo n— >+oo 

From (|2.62p and (|2.66p . we are in the equality case of the Polya-Szego inequality. 
Thanks to Theorem 2 in [8], we obtain the following compactness result : there 
exists a sequence of translation shifts in space, x„ G M, such that 

\\V(j)n - V(/)q(- - x„)||^2 as n +oo. 
Let us now prove the claims (j2.63p and (I2.64p . Remark that, from Schwarz re- 
arrangement classical properties, for all n G N, belongs to $g and satisfies the 
Polya-Szego inequality 

\\VcP*\\l2 < WVcpnh^. (2.67) 
Moreover, for all function (3 such that /3(0) = 0, one has 

/3(0„(x))dx= / (3{(l)#{x))dx, 







which for e < and for /3(t) = ((1 -|- e — t)^ — l)^ implies a^^ = a^p*^ given by the 
expression ()A.2p . Thus, from (|2.16p . 

1, 



Ji<t>n) = ^\\^<Pn\\l2- J_^G{a^^{e))de 

= hl^^nWh- f G{a^#{e))de, 

which provides directly the claim (j2.63p . Let us prove the claim (|2.64p by a contra- 
diction argument. We assume that there exists a sequence ipn in such that 

IIVV', - V0q||^2 < ^ and - V</.q||^^ > 6i. (2.68) 

The contractivity property of the rearrangement in L^-norms and a Sobolev embed- 
ding give 

Moreover by (j2.67p and (|2.68p . we have 

W*\\l2 < Wnh^ < ||V</.Q||i2 + (2.69) 

Hence il^n is bounded in and the sequence VV'rf converges to V</>q in the 
weak topology. In fact, from Fatou lemma, the inequality (|2.69p implies 



hm IIVV'^IIl^ = ||V</.q|| 



L2- 
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Thus the sequence VV'n converges to V(/)q in L^(]R^) which contradicts ()2.68p . 
Notice that, for all q £ (6, 12), the space <I>g is included in and thus 5o does not 
depend on q. The proof of Proposition 12.21 is now complete. 



3. Nonlinear stability of Q 

We are now ready to prove Theorem 1 1.1 1 in this section. The proof is based on the 
two following arguments : i) The local coercivity property of J stated in Proposition 
12.21 which ensures the compactness of the potential field, and ii) The compactness 
of the whole distribution function in the energy space. 

3.1. Local compactness of the distribution function. We will prove in this 
subsection that the Proposition 12.21 implies the following compactness result: 

Proposition 3.1 (Local compactness of local minimizing sequences). Let p > |. 

Let 5o > the constant defined in Proposition \2.2\ and let fn be a sequence of Ep 
such that 

II/: - QIIlMr) ^ 0, II/: - Q*\\Lvin) ^ 0, limsup:K(/„) < :K(Q), (3.1) 

and 

I|V<^/„-V</)q||^, <<5o. (3.2) 
Then there exists a translation shift Xn such that 

\\fn-Q{--Xn)h^^O asn^+^. (3.3) 

Proof of Proposition COl Let (/„) a sequence of £p satisfying (|3.ip and (|3.2p . 

Step 1: Compactness of the potential. We first remark that, from inequality ()B.4p . 
we have 

nfn) > j^^ - 1 + <t>Ux)) f^J'f-dxdv + 1 ||V0/J|^, , 

which implies, from the change of variable (lA.lip . 

'K{fn)-J{^u) > I ^^{VW+^-^ + ^u{^)){fn'^''' -Q**'-)dxdv 

r+oo 

- I %fS'^(fnis)-Q*is))ds. 

Finally 

r+oo 

nfn) - H{Q) > Ji<PfJ - J{<I,q) + a^l{s)if:{s) - Q*{s))ds. (3.4) 

Now, since (fn) satisfies (|3.ip and (j3.2p . the sequence (/„) is bounded in the energy 
space £p. From classical interpolation inequalities, for 

P 

the sequence (pj^^ belongs to and is bounded in L''(M^). Thus, from ()A.3p we 
have 

a^lis) <c(^ + \]. (3.5) 



S9-3 SI 
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Hence we obtain from Holder inequalities 



'^lis){f*{s)-Q*is))ds 



<2C\\f*-Q*hi 



and 



a-l{s){f*is)-Q*is))ds < \\a^l\\LP'io,i)\\f:-Q 



where p' = < 3. Notice that < 1 which gives, from ()3.5p . the boundedness 



-1 hp' 



< 2C 



1 



-ds = 2C 1 



P 



q-1 



" <P/n "LP (0,1) 

We have then the convergence 

a^l{s)if::{s)-Q*{s))ds^O 

as n — )• +00 and, injecting this in (|3.4p . we conclude from ()3.ip that 

hin J%J<J(<^q). 



n— >+oo 



(3.6) 



Together with the condition (|3.2p . this allows us to apply Proposition (|2.2p and we 
conclude that there exists a sequence of translation shifts in space Xn such that 



\\V(j)f„ - V4>q{- - Xn)\\i^2 -^0 as n +oo. 



(3.7) 



Step 2: Convergence of fn {■ + Xn, ■) in- £p- To obtain the convergence in the 
energy space £p, the method that we chose is very similar with the method developed 
in |23) . We renote := (• + Xn, •)■ We remark first that since Q = Q*'^Q 



j^^ {VW+^ -^ + ^q) [fn" - Q) dxdv 



a~Ms){f:{s)-Q*{s))ds 



< UQ\\L^\\fn-Q*\\L^, 



and thus 



(^^fTT - 1 + ^q{x)) (/^^'^ - q) dxdv ^ 
Now, from the inequality (IB.4p . it implies that 

liminf /" (y/\v\-^ + 1 - 1 + (poix)) ifn - Q) dxdv > 0. 



(3.8) 



Hence, since 



nfn) = nQ) + \ l|V0/„ - V0q||2,+ [ (^^^^2^-1 + 4>q(x)) ifn - Q) dxdv, 

in which 

limsup:K(/„) < :K(Q) and ^lirn_ ||V0/„ - V0q||^2 = 0, 

n— >+oo 

we obtain, as n — t- +oo. 



n— >+oo 



/ U\v\^ + 1 - 1 + ^q(x)\ ifn - Q) dxdv ^ 0. 



(3.9) 



STABILITY OF ISOTROPIC STEADY STATES FOR RELATIVISTIC VLASOV-POISSON 21 



The two convergences (j3.8p and (j3.9p yield 

Tn-= / eQ{x,v){fn- fn'^'^]dxdv as +00, (3.10) 

where eQ(x,f) := y^l^P + 1 — 1 + 4)q{x). As in the proof of ()B.4p . we write T„ in 
the following equivalent form 

Tn = '^M / eQ{x,v)dxdv — / eQ{x,v)dxdv , 

Jt=Q \Js^{t) Js^{t) J 

where 

Sl^it) = {{x,v) G M^ < t < 

From ()B.14p . we have 

yix,v)GSnt), eQix,v) > (/*oa^J-i(t). 

Thus 



hoc 



Tn> dtl (/^oa^o) ^{t)dxdv- l eQ{x,v)dxdv\ , 

Jt=o yjs^it) Js^{t) ) 

and since meas(S'"(t)) = meas(S'2 (t)) for all t G M+, 
/■+00 /> 

Tn> dt [(/* o a0Q)"^(t) - eQ{x,v)] dxdv. 

Jt=0 JSJlit) 

Remark from ()B.13p . that the right term is nonnegative and thus, from p.lOp . we 
get as n — 7- +00 



-00 



An:= dt [{f*oa^Qy\t)-eQix,v)]dxdv^O (3.11) 

Jt=0 JS^it) 

We now claim that this implies 
/■+00 /• 

Bn:= dt [{Q*oa^Q)-\t)-eQ{x,v)]dxdv^O (3.12) 

Jt=o Jnj^{t) 

as n — >• +00 where 

n^{t) = {{x,v) e M^ fn{x,v) < t < Q{x,v)}. 
To prove it, we decompose 

s^ = {s^\n^)u{s^nn^) and = {ni^\s^)u {s^ nn^). 

Thus 

An-Bn= I dt I [eQ{x,v) - {Q* o a^QY^{t)\dxdv 

Jt=o Jnri(t)\s^{t) 

hoc 



+ / dt [{fn°a^Q) '^{t) - eQ{x,v)]dxdv 



t=o Jss{t)\ni^{t) 
00 



+ / dt [if* o a^Q)-\t) - (Q* o a^^rHt)] dxdv 

Jt=o Js^it)nn^(t) 

(3.13) 
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Now let us examine each term as n — )• +00. We first observe that for g,h G 
we have 



hoo 

meas 



{{g < t < h})dt = {h- g)+dxdv,. (3.14) 

JR6 



Thus we obtain 

r+00 r+00 r J, 

/ meas{S^{t)\n^{t))dt < / meas({Q < t < fn '^])dt = / {fj'^ -Q)+dxdv, 
Jo Jo 

which gives, from (|3.ip . 

r+00 

/ meas{S^{t)\n^it))dt < H/^'^^ - Q^i = l/^ - Q*\li ^ 0, 
Jo 

and similarly for meas(r22 (0\'S'2 (^))- Using in addition the estimate 

\eQ{x,v)\ < |0q(O)|, \{f:oa^^r\t)\ < |0q(O)|, o a^J-i(t)| < \cPq{0)1 

we deduce that the first two terms of ()3.13p converge to as n — t- +00. We now deal 
with the third term. Combining the strong convergence in ()3.ip . the monotonicity 
of /* and the continuity of Q* , we get 

Ve G ((/)q(0),0), /* o 00^(6) Q* o a^Q{e) as n ^ +00. 

Thus for e G {(f)Q{0),0) such that Q* o a(f,g{e) > t we have for n large enough 

/* 00^(6) >t, 

which from the definition of the pseudoinverse (/* o a,^^)^^ provides 

e<liminf(/*oa0 J-^t). 

From the definition of {Q* o a^^)"^, we conlude that 

liminf(/: o a^^rHt) > {Q* o a^J-\t). 

We just inject it into the third term of ()3.13p to obtain 

liminf(^„ - S„) > 0. 

n— )-+oo 

Moreover, from (|3.1ip . from the definition of ^^'^ from ()B.13p . we have 

An^O and Bn > 0. 
We conclude that the convergence (|3.12p holds true: 



-00 



dt [{Q* oa^^)~^{t) -eQ{x,v)]dxdv ^0. (3.15) 

t=0 J{fn<t<Q} 



Since e 1— )■ F{e) is continuous and strictly decreasing with respect to e = y^|uP + 1- 
1 + (Pq{x) for {x,v) £ {Q{x,v) > 0}, we have 

t < Q{x,v) implies Q* o a^g)~'^{t) — eQ{x,v) > 0. 

Thus, up to a subsequence, 

for a.e. {t,x,v) G x M^, l|-j^<^<Qj — )• 0, as n — )• +cxd. 

Since l{f^<t<Q} < l{t<Q} and 

r+co /■ 

/ / l{t<Q}dxdvdt = IIQIlii < +00, 
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we may apply the dominated convergence theorem to get: 
r+oo 



I dt l^f^^<t^Qjdxdvdt — as n — )• +00, 

Jt=0 JRB 
which, from (|3.14p is equivalent to 

/ {Q ~ fn)+dxdv — )• as n — )• +00. (3.16) 

Now we write 

/ {fn-Q) + dxdv < [ {U- fn'') + dxdv+ f {frf''' - Q) + dxdv 
JR6 JR6 Jrs 

< I meas({/:'^'^ < t < U])dt + WfJ'^ - Q|Ui, 
where, from the equimeasurability of /„ and f^'^ , we have 

f+00 r+oo 

/ meas({/7'=^ < t < fn])dt = / meas({/„ < t < f7''])dt 
Jo Jo „ 

{fj"" - fnhdxdv 



< f {Q- fn)+dxdv + [ {fj"" - Q)+dxdv. 

We finally get 

[ {fn-Q) + dxdv< [ {Q-fnhdxdv + 2\\f:'^''-Q\\Li. 

Now, since ||/*'^'^ - QH^i = \\f* - Q*\\li 0, we obtain from (l3TB the 
convergence 

ll/n - Q||li(r6) as n +00. (3.17) 
Now, from the convergence of V</)/^ to V(j)Q in L^(M^) and from ()3.ip we have 

liminf / (V\v\^ + 1 - ifn - Q) dxdv < 0. (3.18) 

But /n converges almost everywhere in IR^ to Q, thus we have an equality in (|3.18p 
and thus the convergence is strong: 

/ (\J\v\^ + 1) l/n - Q\ dxdv ^ as n ^ +00. (3.19) 
Jr6 ^ ^ 

Similarly, we remark that 

ll/n||LP(R6) = ||/^||lp(R+) IIQ*IIlp(R+) = IIQIIlp{R6), 

when n — )• +00 and we obtain the strong convergence and the proof of Proposi- 
tion [3TT] is completed. 

□ 
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3.2. Stability from the local compactness. Let p > |. From the Hardy- 
Littlewood-Sobolev inequahty and Holder inequalities, we have from the classical 
interpolation's inequality: 

l|V0/ - VMl^ < K \\pf - Pg\\^. <K\\f- 5||f^ 11/ - \\\v\U - g)\\l, . 

(3.20) 

Thus for all f £ S,p 

11/ - Qlls^ < e implies \\V<Pf - V<Pq\\^, < Ke. (3.21) 
Let fixed Eq > Q such that 

Keo < |, 

where K is the constant in (|3.2ip and 5q is defined by Proposition l3.1l Let e G (0, Eq). 
Then an equivalent reformulation of Proposition 13. II is the following: there exists 

< < eo 

such that the following sentence holds true: if / G £p is such that 

lir - QIIlMm) < II/* - QIIl^m) < ^(/) < ^(Q) + V, (3.22) 

and 

IIW/- V0q||^2 <5o, (3.23) 
then there exists a translation shift y G such that 

\\f-Q{--y)h,<^- (3-24) 

Remark that the assumption ()3.23p can be replaced by 

inf ||V</./(- + z)-V</.q||^2 <'5o. (3.25) 

Indeed, on the first hand, if the condition (|3.23p is satisfied, the condition (|3.25p 
is satisfied too. In the other hand, if a function / satisfies (|3.22p and ()3.25p . then 
there exists z G such that / = /(• + -2, •) satisfies ()3.23p . But / satisfies (|3.22p 
too. Thus we have ()3.24p for / and also for /. 

Now we prove theorem 11.11 Let /o G £p such that 

\\h-Qh,<V- (3.26) 

Let f{t) G 3"([0, r), £p) a corresponding renormalized solution to (jl.ip as stated in 
[91 Uni- We want to show that f{t) satisfies (lOll for all t G [0, T). 

Let us first prove that f{t) satisfies (|3.22p for all t. From (|3.26p . we have 

Il/O - Q||li(R6) < 7?, Il/o - Q||lp(M6) < 7?, J{(/o) < -KiQ) + 7/, 

and from the property of contraction of symmetric rearrangement: 

II/* - Q*\\lp{R+) < 11/ - <5IIlp(R6), 

we deduce that /q satisfies ()3.22p . By conservation of the flow, we have 

G (0,T), f{tY = f* and ?{(/(t)) < Ji{fo). 

We conclude that (f3:22|) is satisfied for all t G (0, T). 

Let us now prove that (|3.25p is satisfied for alH G (0, T). At t = 0, since r] < Eq, 
from (j3.2ip . we have 

I|v0/o-v0q||^, <|. 
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Moreover, from the regularity of the flow, the potential satisfies 

V0^(j) G e([o,r),L2(M3)), 

which provides the continuity on [0, T) of the function 
Indeed for all z G M^, we have the uniform boundedness 

||V(/>/(t)(- + z)- v</>q||^2 - \\^(t>f(to)i- + ^) - V'^qIL2 

< ||V</>/(t)(- + 2) - V(/>/(t„)(- + z)||^2 = ||V0/(t) - V0/(t„)||^2 , 

which provides the continuity of /3. Now, by a contradiction argument, assume that 
there exists ti > such that > 6q. Since /3(0) < (5o/2 there exists t2 > such 

that /3(t2) = 3(5g/4. In particular, /(t2) satisfies (|3.22p and (j3.25p and thus there 
exists z{t2) € M'^ such that 

||/(t2)-Q(--x(t2))||£^<e<eo. 

Injecting it into (|3.2ip . we conclude that (3{t2) < Sq/2, which contradicts our as- 
sumption. The proof of Theorem (jl.ip is complete. 



Appendix A. Jacobian of the microscopic energy 

We give some useful properties of the jacobian given by (|2.4p and the re- 
arrangement with respect to the microscopic energy defined in (|2.5p . We recall that 
the space is defined for q > 3 hy (|2.ip . 

We first gather in the following two lemmas some important properties of the 
jacobian a^. 

Lemma A.l (Properties of the Jacobian a^). Let (j) G with q > 3. We recall 
that the Jacobian is defined as 

Ve<0, a0(e) = meas|(x,i;) e : ^/ \v\^ + 1 - 1 + (j){x) < e} . (A.l) 
Then: 

(i) We have the explicit formula: 

Ve<0, a^{e) = — ((1 + e - 0(x))^ - l)^ dx. (A.2) 

3 JR3 

Notice that ((1 + e - (t>{x))l - l) ^ = ((1 + e - (t>(x)f - l) le^^(^x)>o{x). 

(ii) Uff, is on (— oo,0) and is a strictly increasing diffeomorphism from 
(inf 0, 0) onto which defines a^^. Moreover there exist two positive constants 
C and C such that for all e < and for all s > 

The quantity ini (j) is the essential infimum of the measurable function <j). 
Let prove these properties. 
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Proof of Lemma \A.l\ To prove (i), remark that for e < 

+ 1 - 1 + (t){x) < e <^ \4>{x) < e and < ((1 + e - <j){x))l_ - l) ^ | . 
Since lim (j) = 0, the set ja; G : (l){x) < e} is bounded and since (j) belongs 
to L''{R^) with q > 3, we have (j) £ Lf^^(M.^) which imphes 



X ((1 + e - 0(x))+ - l)| belongs to L^^i^^^ 

Thus for all e < 0, a0(e) is finite and after passing to the spherical coordinates in 
velocity we obtain the formula (|A.2p . 



3 



Proof of (a). We define g{e,x) := ((1 + e — (p{x))'^ — l)^. Then, for e < cq < 0, 

< |^(e, x) < 3 ((1 + eo - </.(x))^ - l)^ (1 + eo - 0(x)), 

which, as function of the variable x, belongs to L^(M'^). Indeed its support is 
included in the bounded set |x G : < eg } and G Lf^^(R^). Hence we 

may apply the dominated convergence theorem and get that is a function on 
Ml, nul on (— oo, inf c;/)] (if inf i;^ is finite) and strictly increasing on (inf (j),0). 
We now look for the limit of a(^(e) when e — >• 0. Since (p G ^g, 

3 

a6{e)>—f I I 1 + e+ "^^^\ ] _i) ^ +oo as e 0. 

To conclude the proof of (ii), let us study the behavior of a^{e) as e — )• — oo in the 
case inf (/) = — oo. We observe, from Holder inequality, that 

3 

a<^(e) < (meas{x G 

\J<l,{x)<e ^ ^ J 

(A.4) 

where both terms can be controled. The first term satisfies 

meas{xGM=^ : < e} < /" ('^\'dx<'^^^^, (A.5) 

J<t>{x)<e V e / |er 

and the second term 

9 /• /lUII? 



/ 



(1 + e - 0(x))^ -l)'dx< [ C (1 + |0(x)r) < C f Mi^ + ml) , 



x)<e ^ J (j}(x)<e 

where we use the inequality (lA.Sp . Now, injecting these both inequalities in (|A.4p 
we conclude that there exists a constant C > such that for all e < 

Hi^)<T^i^ + A^)\ml.- (A.6) 

1 



|g-3 \ |g|3 ; IIV^IIL"?- 
Finally the inverse aT^ satisfies for all s > 



-C I + I. (A.7) 

and the properties (ii) are proved. □ 
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The first lemma P\. . 1 1 gi ves first properties about the jacobian at fixed (p £ $q. 
The regularity of the jacobian with respect to the potential (j) is studied in the 
following lemma. 

Lemma A. 2 (Regularity of the Jacobian with respect to 4>). Let q > 3. Then 

(in) Let {(pn), {^n) md (sn) sequences of respectively Ml and i?^. Assume 
that there exist 4> £ ^q, e £ M_ U {— oo} and s G U {+00} such that 

(f)n ^ in L'^(M^), e„ — )• e and Sn — )• s. 

Then by denoting a^{—oo) = 0, a^{0) = +00 and a'^^{+oo) = 0, we have 

a^^nidn) a^{e) and a^l{sn) ^ a^^(s)- (A-8) 

(iv) Let €z and let h = (j) — (j). Then the function (A,e) 1— )• a0+Ah(e) is a 
function on [0, 1] x W_ and we have 

T^a^+xh{e) = -47r / K {e - (p{x) - A/i(x)) hix)dx. (A.9) 
where the function K , defined by 



1 

ir(r?)= (^(1 + 77)^-1)^(1+7?), 

is non decreasing and has its support in . 

(v) With the same notation as (iv). Let s G Then the function A 1— t- o.'^]_xhi' 
is a function on [0, 1] and we have 



Tx-,Us) = ^^y- . (A.10) 

/ K ( a<l^f^{s) - (t>{x) - \h{x) ) dx 

Proof. Proof of (Hi): From the control of the jacobian (IA.3p . we have directly for 

e = —00, 

Let us now treat the case e < such that e 7^ —00. Up to a subsequence, we have 
the convergence 

3 3 
'(1 + e„ + (t)n{x))l - 1)^ ^ ((1 + e + ^{x))l - 1)^ 

almost everywhere in M'^. To obtain the convergence in L"'^(R'^), from a generalized 
dominated convergence theorem, we have just to prove the following L^-convergence, 

3 3 
5n:= f(l + eo + (/)„)+ -1)' ^ f(l + eo + </>)+-!)' =: 9 



where eo = inf e„ < 0. In order to do it, we define the set 

fi= |x eM^ </)(x) < y}. 

Since VL is included in a compact set, the convergence of gn to g in L^(rj) comes 
from the convergence of 0„ to (f) in L^^^(R^). Out of we have g{x) = and, from 
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a similar Holder inequality as ()A.4p . we get 



"Hi' I II J, iia ^ ' / „r™ ^ TEcS . i ^ „ Mf^\ \ ' 



9n(x)dx < C['-^^^^ + \\4>n\\l,] meas{xGM^:</>„(a;)<eo,</.(x)>^}^ ' 



< C [meas{x G : - > y} 



2 

g-3 



< C7 

Thus the sequence (7„ converges to g in L^(M^\J7) and finally in L^(M^). By conse- 
quence, we have the convergence a</)„(en) — )• a^{e) for e s] — oo, 0[. 

Let us now treat the case e = 0. Let M > be an arbitrary constant. Denote 

for all n G N the space r2„ = |x G M'^, < 2(T+fl | ) | ^^-^^ < such that 

Remark that this integral is well defined since the inner function is zero out of 
B{<d,R) for 

i? = max|o, - ll . 

I 2|eo| J 

For n large enough, we have > cq and thus 

To prove that the second term converges to as n — t- +oo, we remark that the set 
of integration of this term is J7„ H B{0,R). Now, from the definitions of m{(j)) and 
Qn, we have for all x G fin 

<Pn[x) ^{x) > + 1^1) + 1 + ^ 2(1 + |x|) ' 

and thus 



n„ \2(1 + \x\)J - in,.nB(o,H) V2(l + \x\ 

Since converges to (j) in L'?(M^), we deduce that the measure of the set O„ni?(0, R) 
converges to 0, which implies that the integral 

3 

m(^) ^ ^ 



converges to as n — )■ +oo. Hence for n large enough a^^{en) > which concludes 
the proof of the convergence of a(f,^{en)- 
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To prove that a^^(s„) — )• a^^{s), we denote := a^^{sn)- We know from the 
above result that, if e„ converges to e G [0,+oo], then 



e„ aAe). 



Hence, any subsequence of (en)neN converges to e = a^^(s), which gives the conver- 
gence of the whole sequence (e„)„eN to e = a^^(s). The proof of (in) is complete. 

Proof of (iv): We recall that h = (p — (p with (j),(f) £ and that A G [0, 1]. From the 
convexity of ^g, the function (j) + \h belongs to $q and a^j^\h is well-defined. For 
e < fixed, we aim to differentiate on (0, 1) the function 

47r /■ . .3 
A ^ a^+xh{e) = ^ ((1 + e - - \h{x)y_ 

First, the set of integration satisfies 

{xGM^ : (0 + A/i)(x) < e} C {x e : < e 



1 ) 2 dx. 



}u{ 



X G 



X < e 



which is included in a compact set of M^. Now, we have for all x in this set 



d_ r 



((1 + e - 0(x) - \h{x))\ -1)1 =3K{e- cpix) - \h{x)) h{x) 



where K{ri) = ^(1 + r/)_^ ~ 1 ) (1 + This derivative can be bound uniformly 
with respect to A by 

K{e-<t){x)-\h{x))\h{x)\ < K (e - <)){x) - <)){x) ] mx) + q){x) 



< C(^l+ ^{x)-(j)ix) 

which, combined with the fact that (p + (l) £ ^focO^^) allows the Lebesgue dominated 
convergence theorem and thus implies (iv). 

Proof of (v): Let s G M^. The continuity of A i— )• a'^^-^his) comes directly from 
(Hi). Let us differentiate this function on Aq G (0, 1). Denote (f)Q = (p + X^h and 
(px = (p + Xh with A 7^ Aq. Then we rewrite 

Since (i'^^{s) converges to a^^{s) as A — t- Aq, the first term satisfies 



and the second term satisfies 

A-Ao 

Using ()A.9p . we finally get the expression (jA.lOp . 



as A — )■ An 



d 

dx' 



A = An 



□ 
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Lemma A. 3 (Changes of variables) . Let a G e°(M) n L°°(M), G G and for 

all {x,v) £ 

e{x, v) = \/\v\'^ + 1 — 1 + (pix). 

Then 

f-0 



/ a{e{x,v)) G {a(j,{e{x,v))) dxdv = / a{e)G{a(j){e))a'^{e)de 

Je(x.v)<0 Jinftb 

a{a^'^{s))G{s)ds, 



'e{x,v)<0 Jiniip 

(A.ll) 



where inf </> is the essential infimum of (j). 



Proof. We perform the change of variable e = P + 1 — 1 + (/"(x), with respect to 
the velocity variable v to get 



/ a{e{x,v)) G {aif,{e{x,v))) dxdv 

Je(x.v)<0 



' e{x,v)<0 

4tt [ dx [ a{e)G{a^{e)){{l + e-(t>{x))l-l)l{l + e-4>{x))de 



a{e)G{a^{e))a'^{e)de. 

inf 

We have then directly (jA.lip since is a C^-diffeomorphism from (inf 0, 0) onto 



Appendix B. Rearrangement with respect to the microscopic 

energy 

We use now this jacobian to define a new rearrangement of any / G £p with 
respect to the microsopic energy P + l — l + (j){x), where (j) belongs to $g given by 
()2.ip . We first recall some basic properties of the classical Schwarz symmetrization. 

Lemma B.l (Schwarz symmetrization). Let f G £p, nonzero, with p > |. We 
define the Schwarz symmetrization f* of f on by 

Vt > 0, /*(t) = inf{s > 0, /i/(s)>t}, 

where fij is the distribution function of f defined by p.7p . Then f* is the unique 
nonincreasing function on ]R!j_ such that f and f* have the same distribution function 

Vs > 0,/i/(s) = /i/.(s). 

Moreover, if f is continuous then f* is continuous. In particular, Q* is continuous. 

Now, from this Schwarz symmetrisation, we define a new rearrangement with 
respect to the microscopic energy. 

Lemma B.2 (Symmetric rearrangement of / with respect to the microscopic en- 
ergy). Let f £ E-p, nonzero, with p > | and (f> £ ^q. Let f* be the Schwarz 
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rearrangement of f in M.^. We recall that the function f*^ is defined by 

' r (a<^(v'bP + l-l + '^(^))) if VWTT-l + cl){x)<0, 

f*<^{x,v) = { 



Then, 



if + 1 - 1 + (p{x) > 0. 

(B.l) 



(i) f*'^ is equimeasurable with f , which means 

f*'^ G Eq{f) = {g€LlnLP with fig = ^/}. 

(ii) f*'^ belongs to £p with 



v\f*^ ^<C{\\Vm,\\fV[ 



2(2p-3) 

6(p-l) II ^11 6(p-l) 



_2p_ 



LP 



+ 



LI 



(B.2) 
(B.3) 



(Hi) A function Q as defined in Theorem [T7J\ satisfies 

F = Q*o on R*_ and Q = on 
(iv) Let f,g£ £p satisfying fig < fif and G <I>, then 

j (VluP + 1 - 1 + (/.(x)) [g - f*^^ dxdv > 0. 
with equality if and only if g = f*'^- In particular 

with equality if and only if g = f*'^^ ■ 

Proof of Lemma \B.^ (i) Equimeasurability: Let /3 G C^(M+,M-|-) satisfying /3(0) 
0. Using the change of variable given by (jA.lip we have 



(B.4) 



(B.5) 



P (f*^{x,v)] dxdv 



+ 00 



fi{f*{s))ds= / P{f{x,v))dxdv, 
which gives the equimeasurabihty of / and f*'^. 
(ii) Control of the kinetic energy: From the definition of f*"^, see (|2.5p . we have 

/ (vi^^2^-i + 0(x))r'^<o, 

and 

-/ (j){x)f**{x,v)dxdv = / V(t){x) ■V(f)f,4'{x)dx. 
Thus, from the Cauchy-Schwartz inequahty 



f*4 



(B.6) 



< l|V</)||i2 ||V</)j.0||^2 + 11^ 11^1 . 

Moreover, the interpolation inequality (jl.lip and the equimesurability of / and f*^ 

2p-3 



yield 



|V0j.^||^2 < C 



\v\f 



2 



(B.7) 
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Hence the inequalities ()B.6P and ()B.7p imply 

\v\r*-K{4,,f)( f M/**)"-||/|li, <o, 



/ 



2 



with 

2p-3 



The control of the kinetic energy ()B.3P follows. 

('iiij T/ie profil Q, fixed point for the rearrangement f*^f : From the assumptions on 
Q in theorem 11.11 the measure of the support of Q is a^g{eQ) and the function F 
is a strictly decreasing C^-diffeomorphism from [m.m(pQ,eQ] onto [0, ||(5||oo]- Thus 
we have for all e G [min (/)q , eo] , 



meas 



meas 



{{x,v) G : Q{x,v) > F{e)} 



= meas {s G : > F(e)} , 

from the definition of the Schwarz symmetrization Q*. We rewrite this equality: for 

ah a G [0, IIQIloo] 

a<^Q oF-^(a) = measjs G M; : Q*{s) > a} . (B.8) 

We know that Q* is a decreasing function on [0,meas{Supp{Q))] = [0, a,^^ (eg)]. 
The equality (jB.SP and the continuity of a^^ o imply the strict decrease of 
Q*. Moreover, since the Schwarz symmetrisation conserves the continuity, Q* is 
continuous on [0,0,^^(6(3)]. We conclude that, for all a G [0, HQIIco]) 

Q* (meas {s G : Q*{s) > a}) = a. 

We deduce that for all e G [min</>Q, eg], F{e) = Q* o a^g{e), which implies in 
particular = F{eQ) = Q* o a^^{eQ). But Q* o is discreasing on i?^ and we 
also have 

F = Q* o on [min 0(5,0). (B.9) 

Let now for all {x,v) G 

e{x,v) := v^|d|2 + 1 - 1 + 0q(x) G [min +00). 

lie{x,v) < 0, from (fROj) . we have Q(x, v) = F{e{x,v)) = Q*'f'Q{x,v). Ue{x,v) > 0, 
from the definition of Q*'t'Q , we have Q*^Q{x,v) = = F{e{x,v)) = Q{x,v). 

(iv) The Hamiltonian of the rearrangement: Let f,g £ £p. Then 



(pgfdxdv, 



WVcPg-Vct^fWl, = - {^g-(t)f){g-f)dxdv 

= — (pggdxdv — I (j)ffdxdv + 2 I 

JmP JM<: 

where we use J (p^g = — J 'V(/)f'V(/)g = J (pgf- Finally we have 

\\V^g - V0/||2, = -2 / cl)g{g - f)dxdv + ||V0/||2, - ||V0g||2, 
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Thus we obtain 

^(5) - nf) 



{VW+^ - 1) (5 - /) dxdv + \ (||V<^/||2, - ||V<^^ 

where the Hamiltonian is defined by (|1.4p . We apply this equahty to g, f**^^ G £p 
with g nonzero and / G £p to get 



n9) = nn')+^ 



V0„ - 



r 



L2 



+ 



+ 1 - 1 + 



<p9) {g-r^')dxdv. 



Hence, to prove the inequahty (jB.Sp . it is sufficient to prove ()B.4p . 
Let / G £p, g £ £.p, (j) £ and let T defined by 



(B.IO) 



The claim T > is a classical inequality for the rearrangements (see [24\ for the 
Schwarz rearrangement for example and [23\ for the new rearrangement). To sim- 
plify the notation we define 



e(x, v) = v[up+T - 1 + (j){x), 
and we use the layer cake representation 



f{x,v) 



h<f(x,y)dt 



to find 



+ CXD 



dt 



e{x,v)dxdv — / e{x,v)dxdv 

JSy.(t) i 



(BAD 



where 



Sl(t) JS2{t) 

Slit) = [ix,v) G M^ rH^,v) < t < gix,v)] , 

S2it) = {ix,v) G M^ gix,v) < t < r'^ix,v)] . 

Now, from the properties about the pseudo-inverse of f*oa^, we deduce that 

e{x, v) > (/* o a^y^ (t), for aU (x, v) G Si{t), 

and, from fig < fij, we have for all t G M"*", meas{Si{t)) < meas{S2{t)). Thus, since 
(roa^)-i<0. 



T > 



dt 



if* ° o.<t>) ^ [t) — v)^ dxdv. 



But, 



e{x, v) < (/* o a^) ^ (t), for aU (x, v) G 5*2 (t), 

which implies on the one hand that T > and in the other hand that, if T = 0, 
we have, for almost all t G M-|_, meas{S2{t)) = 0. Thus we have, almost everywhere 
meas{Si{t)) = meas{S2{t)) = which gives g = f*'^. 

□ 
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Now we give a lemma in which states a method to inverse clearly the function 

/* o a^- 

Lemma B.3 (Pseudo inverse of /* o a^). Let f G E-p, nonzero, with p > | and 
S Let f* the Schwartz rearrangement of f in M^. We define the pseudo 

inverse of f* o for s € (0, as 

if*oa^yHs)=sup{e£{micP,0) : /* o a^(e) > s}. (B.12) 

Then (/* o a^)'^ is a nonincreasing function from (0, ||/||loo) to (inf 0, 0) and for 
all {x,v) G and s G (0, ||/||loo), 

f*'^{x, v)>s^ Vbl' + l - 1 + Hx) < if* o a^rHs), (B.13) 

and 

r*(x, v)<s^ yWTT - 1 + Hx) > if* o a^)-\s). (B.14) 



For the proof of this lemma, we refer to [23l 
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